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Abstract 

Several new computational algorithms arc presented to compute the deadbeat predictive 

control law that brings the output response to rest after a finite number of time steps. The 

first algorithm makes use of a multi-step-ahead output prediction to compute the control law 

without explicitly calculating the controllability matrix. The system identification must be 

performed first and then the predictive control law is designed. The second algorithm uses 

the input and output data directly to compute the feedback law. It combines the system 

identification and the predictive control law into one formulation. The third algorithm uses 

an observable-canonical form realization to design the predictive controller. The relationship 

between all three algorithms is established through the use of the state-space representation. 

All algorithms arc applicable to multi-input multi-output systems with disturbance inputs. 

In addition to the feedback terms, feedforward terms may also be added for disturbance 
* Principal Scientist, Structural Dynamics Branch. 

t Assistant Professor, Department of Aerospace and Mechanical Engineering. 
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inputs if they arc measurable. Although the feedforward terms do not influence the stability 
of the closed-loop feedback law, they enhance the performance of the controlled system. 

1 Introduction 

The traditional approach for active control of mechanical and aerospace systems involves 
four key steps including system modeling, system identification testing, controller design 
and verification tests. The procedure is very time consuming and costly. In many cases, 
such as the acoustic noise reduction for aircraft and vibration suppression for spacecraft, 
the approach cannot be quick enough to catch up with the system changes. On-line system 
identification and adaptive controller design become the only solution for the controlled 
system. Advanced algorithms must be developed for autonomous dynamic response and 
uncertainty characterization, and the controller design directly from input and output data. 

There is a great amount of literature on the subject of adaptive control . 1-10 Most of 
them use a linear input-output model that describes the current output prediction as a linear 
combination of past input and output measurements. The finite difference model, which is 
commonly called the Auto- Regressive moving average model with eXogenous input (ARX), 
is the one used most often by researchers for the adaptive control design. For example, 
the Generalized Predictive Control (GPC ) 5 starts with the ARX model with the absence of 
the direct transmission term and builds a multi-step ahead output predictor by solving the 
Diophantinc equation recursively. The predictive control law is then computed using the 
Toeplitz matrix formed from the step response time history of the system in conjunction 
with a cost function with weighted input and output. There are three design parameters 
involved including the control weight, the prediction horizon and the control horizon. A 
proper combination of these parameters is required in order to guarantee stability of the 
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predictive control law. In contrast to the conventional approach, a novel approach has 
been introduced by the authors 12 integrating a state-space based modern control into its 
corresponding ARX model. It exploits the use of the relationship between the state-space 
model and the ARX model. The predictive controller thus derived has the same form as 
those derived from classical input-output models with the direct transmission term. Yet it 
may also be implemented as an observer-based full-state feedback controller. This provides 
flexibilities for control engineers to perform their job in a way that they prefer. Similar 
to GPC, the approach has one control design parameter and one identification parameter 
related to the order of the system. The control design parameter, which is similar to the GPC 
control horizon, gives the number of time steps for the system to become deadbeat (rest). 
For convenience, the approach described in Ref. [12] is referred to as the Deadbeat Predictive 
Control (DPC). The DPC guarantees closed-loop stability for a controllable system regardless 
of minimum or non-minimum phase. No special treatment is required when the system has 
a direct transmission term. 

This paper develops several new deadbeat control algorithms to compute the deadbeat 
predictive control law. The feedback law is supposed to bring the output response to rest 
after a few specific time steps. The first algorithm makes use of a multi-step-ahead output 
prediction to compute the DPC without explicitly computing the controllability matrix as 
shown in Ref. [12]. Given the coefficient matrices of an ARX model, a recursive formulation 
for computing the multi-step-ahead output prediction is presented. The recursive formula 
is somewhat different from the one described in Ref. [5] for the Diophantine equation. The 
second algorithm uses the input and output data directly to compute the DPC without 
using the ARX coefficient matrices. It combines the system identification and the predictive 
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control law into one formulation. The third algorithm uses an observable-canonical form 
realization from an ARX model to derive the DPC. The approach is similar to that used in 
Ref. [12]. However, it has a different form of companion matrix for the state matrix. The 
relationship between all three algorithms is established through the use of the state-space 
representation. All three algorithms are applicable to multi-input multi-output systems with 
disturbance inputs. In addition to the feedback terms for DPC, feedforward terms may also 
be added for disturbance inputs if they are measurable. Although the feedforward terms do 
not influence the stability of the closed-loop feedback design, they enhance the performance 
of the controlled system. All good features for the method described in Ref. [12] remain true 
for the algorithms developed in this paper. 

2 Multi-Step Output Prediction 

The input output relationship of a linear system, even a nonlinear system, is commonly 
described by a finite difference model. Given a system with r inputs and m outputs, the 
finite difference equation for the r x 1 input u(k) and the m x 1 output y(k) at time k is 

y(k) = aiy(k - 1) + a 2 y(k - 2) + b a p y{k - p) 

+ 0o u(k) + 0i u(k — 1) + 02 u(k — 2) -+ + 0 p u(k — p) (1) 

It simply means that the current output can be predicted by the past input and output 
time histories. The finite difference model is also often referred to as the ARX model where 
AR refers to the AutoRegrcssive part and X refers to the eXogeneous part. The coefficient 
matrices, cq (* = 1, 2, . . . , p) of m x m and 0i (i = 0, 1, . . . ,p ) ofmxr, are commonly referred 
to as the observer Markov parameters (OMP) or ARX parameters. The matrix 0 O is the 
direct transmission term. 
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By shifting a time step, one obtains 


y(k + 1) = a\y{k) + a 2 y(k - 1) H h a p y(k -p + 1) 

+ /3ou(k + 1) + (3iu(k) + f3 2 u(k — 1) + • • • + (3 p u{k — p + 1) (2) 

Define the following quantities 

(i) 

a\ — ot\Qt\ + a 2 

C 1 ) i 

ot\ = aia 2 + a 3 

(l) _ 

&p-i — aiQp_i + a p 
= aiQ p 

and 

$3 ^ = OCifto + Pi (4) 

Substituting y(k) from Eq. (1) into Eq. (2) yields 

y(k + 1) = a[ l) y{k - 1) + a i 2 ) y(k -2) + f a^y{k - p) 

+ P 0 u(k + 1) + /3Q^u(k) 

+p[ 1] u(k - 1) + p { 2 ] u(k - 2) + • • • + 0p ] u(k - p ) (5) 

The output measurement at time step k + 1 can be expressed as the sum of past input and 
output data with the absence of the output measurement at time step k. By induction, one 
may express the output measurement at the time step k + j by 

y(k+j) = a[ j) y(k - 1) + a% ] y(k — 2) 4 f a { p j) y{k - p) 

+ p 0 u(k + j) + (3o )u (k + j ~ 1) -+ f Po J) u(k) 

+p[^u{k - 1) + P 2 3) u(k ~ 2) H + Pp^u(k - p) (6) 


Pi ^ — Q ; iPi + P 2 

P 2 ^ = a l@2 + Pi 

Pp- 1 = Cl i Pp— i + Pp 

P { p ] = «1 Pp 
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where 


a? 

= Ot[ 3 ^Qq + a 2* ^ 

0 ? 

= a?- l) . 

c4 J) 

= a[ j ~^a 2 + ap _1) 

& 

= a { r 1] 

.. 

1 

d 

+ 

7 

a 

jd 

7 

.. d 

/ft 

= a?' 1 ’, 

<Xp ] 

d-i) 

- Oi ’a p 

0 f 

= 


o(j-i) 

h 

3t l) 


Mp-1 -r Mp 

Pp 


(7) 


and 


^ ) = a ( /- 1) /3 o + M J_1) 


(8) 


Note that = a, and fif® = A for any possible integer 1,2, .. . including 0 if applicable. 
With some algebraic operation, Eq. (8) can also be expressed by 

4 0) = A) 

Po k) = At + E OiiP { Q~ x) for k - 1, . . . , p 


1=1 


(9) 


= E l> f° r k = p+l,...,oo 


j(k-i) 


i— 1 


Similar to Eq. (9), a[ j ^ = i; aq + a^ 1 j can also be written as 


. 0 - 1 ) 


O—i) 


( 0 ) 

= O'! 

Jk) 


Q i — o;*:+i + E cija j 
1 = 1 

(*) £ (fc-t) 

cki = E cqa 1 

t=l 


(fc-i) 


for A; = 1 , . . . ,p — 1 


( 10 ) 


for k = p, ... ,oo 

Observation of Eq. (9) and (10) reveals that I3 i p ) and a[ 3) for j > p is a linear combination 
of its past p parameters weighted by the parameters ai,a 2 , • . . ,a p . This property is very 
useful in developing predictive control designs. The quantities (3^ (i = 0, 1, . . .) are, in fact, 
the pulse response sequence which will be shown later. On the other hand, the quantities 
a[9 (* = 0, 1, . . .) are the observer gain Markov parameters which can be used to compute 
an observer for state estimation. 

Let the index j be j = 1, 2, . . . , q, q + 1, . . . , s — 1. Equation (7) produces the following 
matrix equation, 

y 3 (k) = Tu s (k) + Bu p (k - p) + Ay p (k - p) (11) 
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where 


y(k) 

y(k + 1) 


u(k) 

u(k + 1) 


Vs(k) = y(k + q) , u s (k)= u(k + q) 
y(k + q + 1) u(k + q+ 1) 


L y(k + s- 1) J L 

y(k-p) 

= . . u p {k-p ) 

. »(*-!) . 


u(A: + s — 1) J 

m(A: — p) 
w(A: — p + 1) 

w(A: — 1) 


T = 


B = 


A = 


PP 

Po 


pp 

4 ,_1) ■ 

• A) 

p ( o q+1) 

& - 

• P { 0 1) 

Pt 1] 

4*- 2) • 

■ Pi a ~ q - 

Pp 

Pp- 1 

■ Px 

w 

4’ 1 . ■ 

• Px ] 

P { p q) 

■ 

• ^ 

P ( p q+1) 

/o(<7+l) 

Pp-1 

• p[ q+1) 

p ( r i) 


■ Pt l) 

QLp 

Qfp_ i 

«1 

Otp ] 

«|2. • 

• «1 1} 

«i 9) 

ap-i • 

• a ( ! 9) 

V 

q (<7+1) • 

a p- 1 

• a {q+1) 

<x { p~ X) 

Q (S ‘ 1} * 

Q p-1 

- a ( r i} 


The quantity y s (k) represents the output vector with a total of s data points for each sensor 
from the time step k to k + s — 1, whereas y p (k — p) includes the p data from k — p to k — 1. 
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Similarly, u s (k ) has s input data points starting from the time step k and u p (k — p ) has p 
input data points from k — p. The matrix T is commonly called the Toeplitz matrix which is 
formed from the parameters, /3 0 ,/3q , . . . , and /3q~^ (the pulse response sequence). Indeed, 
assume that before time step k, the system is at rest, i.e., u p {k — p) = 0 and y v (k — p) = 0. 
At time step k, one applies to the system an unit pulse one at a time for each input, i.e., 
u(k) = 1 for a single input and u(k + 1) = u(k + 2) = . . . = 0. Equation (11) shows that 
y(*0 = An y(k + 1) = , y{k + s - 1) = /?J S_1) . 

The vector y 3 (k ) in Equation (11) consists of three terms. The first term is the input 
vector u s (k) including future inputs from time step k to k + s — 1. Relative to the same 
time k, the second and third terms, u p (k — p) and y p (k — p), axe input and output vectors, 
respectively, with past known quantities from k — p to k — 1. The future input vector u s (k) 
is to be determined for feedback control. 

3 Deadbeat Predictive Control Designs 

There are two predictive control designs to be shown in this section. The first design is based 
on Eq. (11) with the assumption that the parameters aj, a 2 , . . . , a p and /3 0 ,/3i,..., fi p , are 
given a priori. The second design uses the input and output data directly without explicitly 
involving the parameters a .\ , a 2 , . . . , a p and /? 0 , A, • ■ • , /dp- 

3.1 Indirect Algorithm 

Consider the question: what should the future input signal u(k), u(k+ 1), • • • , u(k + q — 1) be 
to make the future output sequence y(k + q), y(k + q + 1), • • • , oo equal to zero (deadbeat)? 
Here we have assumed that the control action starts at time step k. Before time k, the 
system is open- loop. 
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Let the control action be turned on at time step k and ended at k + q. In other words, 
the control action occurs only from u(k ) to u(k + q — 1), i.c., u(k + q) and beyond the step 
k + q arc all zero. Under this condition, Eq. (11) produces the following equation, 


y p (k + q) = T'u q (k) + B'u p (k - p) + A'y p {k - p) 


(14) 


where 


and 



y(k + q ) 


u(k) 

y p (k + q) = 

y(k + q+ 1) 

, Uq(k) 

u(k + 1) 


. y(k + q + p- 1) 


u(k + q — 1) 


T'=T(qm + 1 : pm -f gm, 1 : qr)= 

/3“ P+" 

- rf’i 

- /#> 



ft(Q+P- 

L mo 

- i) /o(q+p— 2) 

MO 

1 

B'=B{qm + 1 : pm + qm , :) = 

0 (q) 

P ( p q+1) 

/3“, • • • 

/o(9+l) 

Mp- 1 

A (9) 1 
p[ q+1) 


_ 0 (q+p ~ l) 

n(q+p-\) 
Mp— ] 

Mq+p-l) 



n {q) 

a p- 1 


P 

Q ( " +1) * 

a p~ 1 

.. 

p 

a _i 



(15) 


(16) 


A’=A(qm + 1 : pm + qm , :) = 


Equation (14) is a reduced version of Eq. (11) by cutting its first q equations and the equations 
beyond q + p — 1 . The matrix T of dimension pm x qr is formed from the pulse response 
(system Markov parameters). Note that m is the number of outputs, p is the order of the 
ARX model, r is the number of inputs, and q is the number of control steps. If one flips the 
columns in the left/right direction and preserves the row's of T 7 , it becomes a Hankcl matrix 
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of the pulse response, i.e., 


^ /T 1 ' d" 

af /#” ■■■ & ) 0i? +1> 

;if ,i,r" ... a,'’ ■ ^ dr-" 

The Hankel matrix is known to have maximum rank of n which is the order of the system 
if pm > n. Choosing any number which is larger than pm does not increase the rank of T' . 
That is why the number of rows for T' is chosen to be pm even though any number greater 
than pm may be used to form Eq. (14). The integer q must also be chosen such that qr > n 
to make sure that the Hankel matrix has rank n. 

The output vector y p (k + q) in Eq. (14) includes the output sequence from the time 
step k + q to k + q + p — 1. It depends on the input vector u q {k ) for the input sequence 
from the time step k to k + q — 1 which is one step behind the step k + q for the first output 
in y p (k + q). It also relies on u p (k - p) and y p (k - p) consisting of the input and output 
sequences from the time step k - p to k - 1. The significance of Eq. (14) is that the input 
and output relation has been rewritten so that the output at time k + q and beyond can be 
computed from the input sequence from k-p to k + q- l and the output sequence from 
k — p to k — 1. In other words, the output sequence from k to k + q — 1 is not required to 
be known for the prediction of the output at the time k + q and beyond. This prediction 
characteristic can be capitalized on for the feedback design shown below. 

From Eq. (14), it is clear that the following equality 

u,(k) = -PT [BV* - p) + A'y p (k - p)j ( 18 ) 
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will bring y p (k + q) to rest, i.e., 


y p {k + q) = 

The first r rows of Eq. (18) thus gives 


y(k + q) 
y(k + q + 1) 

[ y(k + q + p- 1) J 


= 0 


u(k ) = —first r rows of {[T 7 ]*} [B'u p (k — p) + A'y p (k — p)] 


= ot c iV{k - 1) + ol\ y(k - 2) H b a p y(k - p ) 

+p c 1 u(k - 1) + 0 c 2 u{k - 2) + • • • + (f p u{k - p) (19) 

where the superscript c signifies the control parameters. The feedback control parameters 
al,...,a p and fl%,...,P p arc to be used to compute the current control signal u(k) using 
the past p input and output measurements. The control action is supposed to bring the 
output to zero for all time steps larger than k + q. Along with the desired zero input u(k : + q) 
and beyond, the system should be at rest, i.e., deadbeat, beyond time step k + q. That is in 
theory. In practice, when the system has input and output uncertainties, the control action 
can only bring the output down to the the level of uncertainties. 


3.1.1 Computational Steps 

The indirect method for predictive control design is summarized as follows. 

1) Use any system identification (batch or recursive) technique to determine the open-loop 
observer Markov parameters (ARX) parameters a l5 . . . , a p , and do, Pi,..., P p , before 
the control action is turned on. 

2) Compute the system Markov parameters (pulse response sequence) with the recursive 
formula, Eq. (8), and form the Toeplitz matrix T' shown in Eq. (16). The integer q 
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must be properly chosen such that the rank of T' is n or pm whichever is the least 
where n is the order of the system and m is the number of outputs. 

3) Form matrices A' and B' shown in Eq. (16) with their elements computed using the 
recursive formula, Eq. (7). 


4) Use Eq. (19) to compute the feedback control parameters a\, . . . ,a° and /3f, /3%, . . . , /3p. 

3.2 Direct Algorithm 


One may be interested in computing the feedback control parameters shown in Eq. (19) 
directly from input and output data. That is to bypass the first three steps of the indirect 
method for a predictive control design. To achieve the goal, first start with Eqs. (12) and 
(13), and form the following input and output matrices. 


Y s (k) = [y a (k) y a (k + l) ■■■ y s (k + N - 1) ] 

y(k) y(k + 1) y(k + N- 1) 

y(k+ 1) y(k + 2) ••• y(k + N) 

_y(k + s - 1) y(k + s) ■■■ y(k + s + N — 2) 

U 3 (k) = [u s (k) u s (k + 1) u s (k + TV - 1) ] 

u(k) u(k + 1) u(k + TV - 1) 

u{k + 1) u(k + 2) ••• u(k + N) 

_u(k + s — 1) u(k + s) ■■■ u(k + s + N~2) 


( 20 ) 
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and 


Yp(k-p) =[y P (k-p) y p (k-p+ 1) ••• y s (k-p + N- 1)] 

y(k — p) y(k — p+ 1) ••• y{k — p+N — 1) 

y(k — p+ 1) y(k — p + 2) ••• y(k — p + N) 

y{k — 1) ?/(/?) ••• y(A; + 7V-2) 

(21) 

C/ p (/c - p) = [u p (A; - p) u p (k-p+ 1) ••• w p (A: - p + JV - 1) ] 

u(k — p) u(k — p + 1) ••• u(k — p + N— 1) 

u(k — p+ 1) u(/c — p + 2) ••• u(k—p + N ) 

u(fc — 1) «(&) ••• w(A: + — 2) 

where IV is an integer. The data matrices U s (k ) and Y s (k ) include the input and output 

data information up to the data point k + s + N — 2, whereas U p (k — p) and Y p (k — p) have 

data up to k N — 2. 

Application of Eq. (11) yields 

Y s (k) = TU,(k) + BU p {k -p)+ AY p (k - p) (22) 

or 

U s (k) 

Y s (k) = [ T B A] U p (k - p) (23) 

Y p (k-p) 

Let the integers s and N be chosen large enough in the sense that the matrix U s (k ) of 
dimension sr x N with sr < N has rank sr, the matrix U p (k — p) of dimension pr x N with 
pr < N has rank pr, and the matrix Y p (k — p) of dimension pm x N with pm < N has 
rank pr. Again, r means the number of inputs and m represents the number of outputs. 
Equation (22) produces the following least-squares solution 

U,(k) l f 

[ T B A ] = Y s (k) U p (k - p) (24) 

Y p (k- P ) 
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where f means the pseudo-inverse. From the triple [T, B, A ], it is easy to extract the 
triple [ T', B' , A! ] defined in Eq. (16) for computing the control parameters a \, . . . , 
and 0\, 0l,...,0 c v using Eq. (19). 

Equation (22) has some redundant equations which may be eliminated to directly 
compute the triple [ T' , B', A' ] without computing [ T, B, A }. Indeed, let us set 

s = q + p 

and delete the first qm rows of Eq. (24). Equation (24) reduces to 

' tw k) V 

[ T" B' A' }= Y p (k + q) U p (k - p) (25) 

Y p (k-p) 

where T", B'. and A! arc obtained by deleting the first qm rows of T and B, and A respec- 
tively. The matrices B' and A! arc identical to those defined in Eq. (16). The matrix T" has 
more columns than T' defined in Eq. (16), i.e., 

T = T"(:, 1 : qr) (26) 

Now, the data matrices become 

Y p (k + q) = [y p (k + q) y p {k + q + 1) y p (k + q + N — 1) ] 

y(k + q) y(k + q + 1) ••• y(k + q + N - 1) 

y{k + q+ 1) y(k + q + 2) ••• y(k + q + N) 

.y(k + q + P~ 1) y(k + q+p) ••• y(k + q + p + N - 2) 

(27) 

[ ^9+p(^) / Uq+p(k + 1) ’ ^q+p(^ T ^ f) j 

u(k) u(k + 1) U (k + N- 1) 

u(k + 1) u(k + 2) u(k + N) 

_u(k + q + p — 1) u(k + s) ■■■ u(k + q + p + N — 2) 

At this moment, all input and output data arc measured from the open-loop system, before 

any control action begins. 
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From the triple [T", 3 ', A% the control law from Eq. (19) can be applied to computed 
the control gain parameters, 

U(k) — —first r rows of { [7’ // (:, 1 : gr)]*} [B'u p (k — p) + A'y p (k — p)] 

= a\y{k - 1) +a c 2 y(k - 2) 4 + a c p y(k - p) 

+0[u(k - 1) + (3 c 2 u(k - 2) + • • • + (3 c p u{k - p) (28) 

3.2.1 Computational Steps 

The computation steps involved in the direct method for predictive control design are: 

1) Form the data matrices Y p (k + q) and U q+P (k) defined in Eq. (27), and Y p (k - p) and 
U p (k — p) defined in Eq. (21). The integer p must be chosen such that pm > n where 
m is the number of outputs and n is the anticipated system order. The integer q > p 
is chosen such that the Hankcl matrix defined in Eq. (17) has rank n. 

2) Compute the least-squares solution, Eq. (25), to determine T", 3' . and A! . 

3) Use Eq. (28) to compute the feedback control parameters Oj, . . . , a p and /?£, (3 0 p . 

The direct method seems simpler in computation. Nevertheless, it by no means implies 
that the direct method will save time in computation compaired to the indirect method which 
includes the computation of the observer Markov (ARX) parameters. The reason is that the 
direct method involves a larger matrix manipulation in computing T" , 3' , and A' from 
Eq. (25). In addition, there is no theoretical proof that the direct method is more robust 
than the indirect method with the presence of system uncertainties. 
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4 Observable- Canonical Form Representation 


Some researchers may be interested in knowing the corresponding state-space representation 
for the techniques described earlier. There are cases where a state-space model is very useful 
in conducting controller designs particularly for those engineers who have strong background 
in modern control theory. It also provides them with flexibilities for real-time implementa- 
tion. 


Given Eq. (1) or equivalently Eq. (6), there is a direct way of determining the system 
matrices for a state-space representation. Let us choose the state variables as 
x i(k) = y(k ) - /3ou(k) 
x 2 (k) = y(k + 1) - P 0 u(k + 1) - (3^u(k) 
x s{k) = y(k + 2) - /3 0 u(k + 2) - $^u{k + 1) - 0^u(k) 

(29) 

x p(k) = y(k + p~l) 

-p 0 u(k +p - 1) - 0Q^u(k + p- 2)-, • • • , -/$ p ~ 1] u(k ) 
where each vector Xi(k), i = 1, 2, . . . , p, has length m, which is the number of outputs. 
The set of equations in Eq. (29) yields 

Xi(k + 1) = x 2 (k ) + 0„^u(k) 
x 2 (k + 1) = Xs(k) + 0^u(k) 
x 3 (k + 1) = x 4 (k) + 0^u(k) 

■ : : (30) 

x p{k + 1) = y(k +p) 

~(3 0 u(k + p) - Po ] u(k + p - 1)-, • • • , -0Q P ~ 1) u(k+ 1) 

= aix p (k) + a 2 x p _i(k) H b apX^k) + 0^u(k) 

where the last equation is obtained by using Eqs. (1) and (9). The above equations can be 
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arranged in matrix form as 


where 


x(k + 1) = Ax(k ) + Du(k) 
y(k) = Cx(k) + Du(k) 


x(k) = 


xi(k) 

x 2 {k) 

x p -i(k) 
. x p (k) 



' 0 

I 

0 

•• 0 

0 ' 


0 

0 

I 

■■ 0 

0 

, A = 

0 

0 

0 

0 

I 



G!p_l 

Otp—2 

■ • a 2 

aj 


C=\I 0 


D = Po 

Recall that p is the number of available observer Markov parameters, m the number of 
outputs and r the number of inputs. The state vector x becomes an mp x 1 vector, the 
state matrix A an mp x mp matrix, the input matrix B an mp x r matrix, and the output 
matrix C an m x mp matrix. A state-space model in the form of Eq. (33) is said to be in 
the canonical-form. 

The observability matrix of the canonical-form realization is 

c i r/ o o ■■■ o* 

CA 0 1 0 • • • 0 

Q = CA 2 = 0 0 I ■ ■ • 0 (34) 

_ CA p ~ l \ [0 0 0 ••• I 

The matrix Q is an identity matrix which is obviously nonsingular. It implies that the ob- 
servability matrix Q has a rank of mp and thus all states in the state vector x are observable. 
Are they controllable as well? First, form the controllability matrix 


H = \B AB A 2 B ••• A S ~ 1 B] 
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0l 2> 

0i 3> ■ 

1 


A 2) 

A 3> 

0l 4> ■ 

•• 4 S+1) 


0l 3> 

A 41 

4 5) • 

• • (i ,+2) 

(35) 

0F 

AT" 

Pp 2) ■ 

• • fi s+p ~ l) 



where Eq. (9) has been used to form this matrix. The controllability matrix H is a pm x rs 
Hankel matrix formed from system Markov parameters (pulse response sequence). The 
maximum rank of H is n which is the order of the system. Assume that the integer s is 
chosen large enough, i.e., rs > pm. If pm = n, the rank of H is identical to that of Q. 
As a result, the state-space representation, Eq. (33), is a minimum realization from given 
observer Markov parameters ari, <* 2 , . . . , a p , do, /3\, , (3 P . A state-space representation is a 
minimum realization if and only if it is controllable and observable, i.e., the state matrix is 
the minimum order. 

The maximum order of the model, Eq. (33), is mp which is the dimension of the 
realized state matrix A. If the number p is chosen such that mp is larger than the order of 
the system, then the triplet [A, B , C] is not a minimum realization. This is because the 
canonical-form, Eq. (33), is observable (the rank of Q is pm), but not controllable (the rank of 
H is less than pm). In this case, some of the states in the state vector x arc not controllable. 
In general, the order of a system under test is not known a priori. The number mp tends to 
be chosen significantly larger than the “effective” order of the system to accommodate the 
measurement noise and system uncertainties. “Effective” here means the part of the model 
that can be excited by the inputs and measured by the outputs. A state-space model in the 
form of Eq. (33) is thus named to be in the observable canonical-form. 

One may be interested in knowing the observer which makes the state matrix become 
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deadbeat in certain number of time steps. First, recall the matrices o j 1 \ , . . . , a\ 




defined in Eq. (10). The following observer gain matrix 


G = 


( 0 ) 


will result in 


(A + GC) P = 


a!”' 

«?> 


(p- 2) 
a i 


a 




a { r 2) 

at 1} 


I 

0 

0 


0 

I 

0 


0 0 
0 0 

0 I 


ip 


a 


(p— l) . 

I + Olp Op- 1 Oip - 2 


= 0 


(36) 


(37) 


- a 2 eq 

In other words, the observer gain G will bring the observer state matrix A + GC to zero in p 
steps. The matrix G may be used to estimate the state vector x for full state feedback control 
designs. For a system with significant uncertainties, the deadbeat observer will converge to 
the steady state Kalman filter under certain conditions regarding the data length and the 
choice of p. 

Careful examination of the definition for the state vector, Eq. (29), and the predictive 
output equation, Eq. (11), reveals that 


x(k) = B°u p (k — p) + A°y p (k — p) 


(38) 
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where B° is a pm x pr matrix and A° is a pm x pm matrix, 


B°—B{ 1 : pm , :) = 


A°=A(1 : pm, :) = 


ftp 

Pp~ 1 

•• A 


e ■ 

■■ /3| ,) 


ffA ■ 

.. £<»-■> 

Otp 

OCp—\ 

a, 

Q* 11 

rv (1) • 

a p - 1 

■' a'," 

qIo-O 

o> _1) . 

a p - 1 

.'. a <r'> 


( 39 ) 


Note that the state vector has size pm x 1. Equation (38) signifies the relationship between 
the state vector and the input and output data. It implies that the state at time step k can 
be estimated from the past p input and output data. This provides the basis for predictive 
control designs for a system represented by a state-space model. 

4.1 Deadbeat Predictive Control Gain 

Given a state-space representation, there are many ways to design a feedback law to control 
the system. Common methods include optimal control design, pole placement technique, 
virtual passive technique, etc. Here, a deadbeat feedback design similar to that discussed 
earlier will be introduced. 

With some algebraic manipulations, Eq. (31) produces 


x(k + 1) = Ax(k) + Bu(k) 
x(k + 2) = A 2 x{k) + [ AB B 


u(k) 

u(k + 1) 


x(k + q) = A q x(k) + T'u q (k) 


(40) 
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where 


and 




u(k) 

u(k + 1) 

u(k + q - 1) 


(41) 


T = \A q ~ x B A q ~ 2 B ••• B 



f>t' ) ■ 

1 

/o(9+l) 

Po 

^ ■ 


i(q+p- 1 ) 
> 0 

a{q+p-2) 

Po 

•• ft'. 


(42) 


The matrix T' is an n x qr controllability matrix with n being the order of the system and 
r the number of inputs. The integer q must be chosen such that qr > n to assure that the 
matrix T' has rank of n. Note that T' shown in both Eqs. (16) and (42) are identical. 

Equation (40) shows that the state x(k + q) at time k + q becomes zero when the input 
series u(k),u{k + 1), . . . , u(k + q — 1) is given by 


u q {k) = -{T']'A q x(k) 


x(k + q) = 0 


(43) 


which clearly implies that the input u(k) at time k is 


u(k ) = — G c x(k ) 

= —{first r rows of [T'\^}A q x{k) (44) 

Equation (44) gives a state-feedback controller that drives the state x(k) at time step k to 
zero after q time steps. One straightforward method of computing the gain matrix G c is first 
to identify the set of system matrices A. B, C, and D from input and output data, and then 
compute the gain matrix from Eq. (44). 
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Substituting Eq. (38) for x(k) into Eq. (44) yields 


u(k) = —{first r rows of [T'}^}A q {B°u p (k — p) + A°y p (k — p )} 

= a\y{k - 1) + a c 2 y(k - 2) 4 b a c p y(k - p ) 

+P°Mk - 1) + P c 2 u(k - 2) + • • - + (3pii(k - p) (45) 

The control laws obtained from Eq. (19) and Eq. (45) should be identical. This implies 

B' = A q B° and A' = A q A° 


or 

B(qm + 1 : qm + pm, :) = A q B{ 1 : pm, :) 

(46) 

A{qm + 1 : qm + pm, :) = A q A{\ : pm, :) 

This result provides an interesting connection between the state matrix A and the submatri- 
ces of A and B defined in Eq. (13). It should be not surprised because they are all computed 
from the observer Markov parameters £*i, a 2) . . . , a p , /? 0 , Pi, ■ ■ • , P p - 


4.1.1 Computational Steps 

The observable-canonical form representation for the predictive control design is summarized 
in the following 

1) Use any system identification (batch or recursive) technique to determine the open-loop 

observer Markov parameters (ARX) parameters ,a p , and /5 0 , P\, ■ ■ ■ , P p , before 

the control action is turned on. 

2) Form the state-space model shown in Eqs. (31) and (32) with its system matrices 
A, B , C, and D defined in Eq. (33), and the corresponding observer gain matrix defined 
in Eq. (36). 
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3) Compute matrices A° and B° shown in Eq. (39) with their elements computed using 
the recursive formula, Eq. (7). 

4) Calculate the control gain matrix G c defined in Eq. (44) using the controllability matrix 
shown in Eq. (42) with a given integer q. The integer q must be large enough so that 
pr > n where r is the number of inputs and n is the order of the system. 

5) Use Eq. (45) to compute the feedback control parameters Qj, . . . , and /3j , /?£, . . . , /?£. 

Some researchers may prefer to use the state-space representation described by the system 
matrices A, B , C, D, the observer gain matrix G, and the control gain matrix G c for real-time 
implementation. The control gain G c can be computed using any other existing methods 
such as the pole placement techniques, optimal control methods, etc. 

5 Feedback and Feedforward for Disturbance Input 

In addition to the control input, there may be other disturbance inputs applied to the system. 
Some type of disturbances comes from the known sources that can be measured. This section 
addresses the predictive feedback designs including feedforward from the disturbance inputs 
that arc measurable. 

With the disturbance input involved, the finite difference model shown in Eq. (1) 
becomes 


y(k) = aiy(k - 1) + a 2 y{k - 2) 4 h a p y(k - p) 


+ {3c0 u c (k) + PdU c (k - 1) -I- Pc2U c {k - 2) + 1- p cp u c {k - p ) 


+ Pdo u d(k) + Pdi u d(k - 1) + Pd2Ud{k - 2) -I h PdpUd{k - p) (47) 
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where the subscripts c and d are used to signify the corresponding quantities associated 
with the control input and the disturbance input, respectively. Accordingly, Eq. (11) can be 
rewritten as 


yjk) = k) + T d u ds (k) + Byy-pik - p) + B d u d) ,{k - p) + Ay p (k - p ) 


(48) 


where 


u cs (k) - 


u cp (k - p ) = 


u c (k) 
u c {k + 1) 

[ u c (k + s - 1) J 

u c {k - p) 
u c {k — p + 1) 

u c (k - 1) 


'U'dsi.k') 


u d {k) 

u d (k + 1) 

u d (k + s - 1) 


u dp (k - p) = 


Ud(k - p) 
u d (k - p + 1) 

u d (k - 1) 


and 



/To 




/To 



% = 

Pc 0 

/?c0 


, T d = 

g w 

Pd 0 

/To 



PcO 

PcQ 

■ ■ /To 


ds-1) 

PdO 

ob-2) 

PdO 

■ • /To 



' Per 

/T(p-i) 

• • Pci 


Pdp 

Pd(p— 1) 

Pdl 

B c = 


g b) 

Pc(p-1) 

■ 

, B d = 

3 {l) 

Pdp 

3 {1) 

Pd(p-l) 

■ 3 (l) 

Pdi 


. $i-' ) 

d s ~ b 

Pc(p-l) 

■■ rir”. 


1 

^ 1 ‘ 

3 {s ~ l) ■ 

Pd(p-i) 

.. s' t*- 1 ) 
Pdl J 


(49) 


(50) 


In Eq. (48), the subscripts c and d mean the quantities resulting from the control input and 
the disturbance input, respectively. Equations (49) and (50) show that the mathematical 
forms for the control input and the disturbance input arc identical. However, the control 
input is changeable but the disturbance input is not. 

Using the same concept as discussed earlier, let us assume that the control action starts 
at the time step k and hopefully ends at k + q. This assumption is possible in theory for the 
noise-free case without disturbances. It is impossible for the case with random uncorrclated 
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disturbances. However, it is used here to obtain a stable feedback design. Equation (48) 
thus becomes 

y p (k + q) = T^.u cq (k) + T d u dq (k) + B' c u cp (k. — p) + B' d u dp (k - p) + A'y p (k - p) (51) 
where 

T c = T (qm + 1 : qm + pm, 1 : qr c ) 

T d — T (qm + 1 : qm + pm, 1 : qr d ) 

B' c = B c (qm + 1 : qm + pm , :) (52) 

B d — Bd(qm + 1 : qm + pm , :) 

A' = A(qm + 1 : qm + pm , :) 

Note that is a pm x qr c matrix where r c is the number of control inputs and T d is a 
pm x qr d matrix where r d is the number of disturbance inputs. It is unrealistic to predict 
any future disturbance signal beyond time step k + q, assume that the disturbance signal is 
predictable. This statement can be clearly justified by using the state-space representation 
approach similar to that shown in Eqs. (40) to (44). 

For simplicity, assume that the goal of the control action is to minimize the output due 
to the disturbance. From Eq. (51), the control input starting from time k, which satisfies 
the following equation 

u cq (k ) = -[T^ {T d u dq (k) + B' cUcp (k -p)+ B' d u dp (k - p) + A'y p (k - p)} (53) 

will ideally bring the output to zero after q time steps. This control law requires knowledge 
of the future disturbance beyond the current time k, i.e., u dq (k) defined in Eq. (49) with 
s = q + p. If the disturbance is uncorrclated, it is impossible to make any precdiction. Thus, 
the control action should be 


u cq (k) = -[T^{B' c u cp (k -p) + B' d u dp (k - p) 4- A!y p (k - p)} (54) 


25 



which will not bring the output response to zero after the q-step control action but minimize 
it. That is the best one can do for a unknown disturbance sequence. 

The first r rows of Eq. (54) provides the control law for the input at any the time k 

Uc(fc) = -{first r rows of [T^}{Bf c u t9 {k - p) + B' d u dp (k - p) + A’y p {k - p)} 

= a \y{k — 1) + aly(k — 2) H h a c p y(k-p) 

k - 1) + ft c c2 u c (k - 2) + • • • + ft^Ucik - p) 

+Pd\ u d(k — 1) + Pd2 u d{k — 2) H + (3 dp Ud{k - p) (55) 

In addition to the control feedback, the control law shown in Eq. (55) includes the feedforward 
due to the past disturbance time history. Equation (55) may be called the finite-difference 
model for the feedback and feedforward predictive controller. Although the control law 
developed in this section is for the purpose of damping out the output response, it can be 
easily enhanced to follow a desired output response. 

6 Computational Steps 

The indirect method for the predictive control design with feedback and feedforward is 
summarized as follows. 

1) Use any system identification (batch or recursive) technique to determine the open- 

loop observer Markov parameters (ARX parameters), a u ...,a v , Pa, Pep , and 

Pdo, Pdi , • • • , Pdp-, before the control action is turned on. 

2) Compute the system Markov parameters (pulse response sequence) for the map from 
the control input to the system output with the recursive formula, Eq. (8), and form 
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the Toeplitz matrix 7^ shown in Eq. (52). The integer q must be properly chosen such 
that the rank of is n or pm whichever is the least where n is the order of the system 
and rn is the number of outputs. 

3) Form matrices A\ B' c and B' d shown in Eq. (52) with their elements computed using 
the recursive formula, Eq. (7). One may first compute the combined B' from Eq. (7) 
which include the control input and the disturbance input, and then separate them 
into two pieces, i.e., B' c and B' d . 

4) Use Eq. (55) to compute the feedback control parameters a\,...,a c p and P c c \-,Pl 2 ’ • • • > P%i 
and the feedforward parameters /3 dl , /3 d2 , . . . , P dp . 


Although this section only describes the indirect method for computing feedback and feed- 
forward parameters for the system with both control and disturbance inputs. The same 
approach is applicable for the other methods presented in this paper. 

6.1 Closed-Loop Representation 


In order to characterize the closed-loop response, the closed-loop frequency response func- 
tion or state-space representation is commonly needed. The first step is to integrate the 
two finite difference models for the open-loop system and its predictive controller together. 
Equation (47) together with Eq. (55) forms the closed-loop finite difference model, 
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(56) 
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or equivalently, 


v(k) = aiv(k — 1) + a 2 v(k - 2) H b a p v(k — p) 

+ PoUd{k) + 0i Ud{k — 1) + 02 Ud(k — 2) + • • • + 0 p Ud(k — p) (57) 


where 


v(k) = 

0o = 


y{k) 

u c {k) 

I 0co 

0 I 
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' I 
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i 


0d 0 
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i A = 


I 0cQ 

0 I 


0di 


(58) 


for k — 1, 2, , oo, and i — 1, 2, — ,p. The vector v(k) has the length of m + r c where m is 
the number of outputs and r c is the number of control inputs. Each matrix a, has the size of 
(m + r c ) x (m + r c ) and 0i is (m + r^) x where Td is the number of disturbance inputs. A 
state-space representation or its corresponding frequency response function can be directly 
derived from Eq. (57) for closed-loop analysis by examining its closed-loop poles and zeros. 


7 Numerical Example 


A simple spring-mass-damper system is used to illustrate various controllers. Several different 
cases will be discussed ranging from single-input/singlc-output to multi-input /multi-output. 
First, the noise-free case is shown and then the case with additive measurement noise is 
discussed. 

Consider a three-degree-of-frccdom spring-mass-damper system 


M w + zlw + Kw = u 
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where 
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where m*, A;*, i = 1,2,3 are the mass, spring stiffness, and damping coefficients, respec- 
tively. For this system, the order of the equivalent state-state representation is 6 (n = 6). The 
control force applied to each mass is denoted by u i: i = 1, 2, 3. The variables i = 1, 2, 3 arc 
the positions of the three masses measured from their equilibrium positions. In the simula- 
tion, m i = m2 = m3 = 1 Kg, k\ = k 2 = k 3 = 1, 0007V T /m. Ci = C2 = C3 — 0.1 N — sec/ m. The 
system is sampled at 50 Hz (A t = 0.02sec.). Let the measurements y x be the accelerations 
of the three masses, y x = iv t , i — 1,2, 3. 

Let us consider a single-control-input, single-disturbance-input and single-output case 
where the control input to the system is the force on the first mass (i.e., u c — Ui), the 
disturbance input is at the second mass (i.e., u d = 1^2)5 and the output is the acceleration of 
the third mass (i.e., y = 1^3) (non-collocated actuator-sensor). Therefore, the smallest order 
of the ARX model p is 6 corresponding to a deadbeat observer, and the smallest value for 
q is also 6 corresponding to a deadbeat controller which will bring the entire system to rest 
in exactly 6 time steps if no disturbance input is present. Note that this is a non-minimum 
phase system. The choice of the minimum p = q — 6 is to make the Hankcl matrix formed 
from the system pulse response (system Markov parameters) to have rank of 6 which is the 
order of the system. This deadbeat controller is not practical because it needs excessive 
control. Instead, consider the case where the controller is computed with q = 50. The 
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controller computed using the indirect algorithm for this system has the form 

u c (k) = -0080 u c (k - 1) - 0.020u c (/c - 2) - 0.023u c (A; - 3) 

+0.059« c (fc - 4) + 0.094n c (A; - 5) + 0.010n c (A: - 6) 

+ 1.048j/(A: - 1) - 3.819y(Jfc - 2) + 6.404</(A; - 3) 

— 6.785y(A; - 4) + 4.173 y(k - 5) - 1.603y(* - 6) 

-0.058u d (fc - 1) - 0.278w d (fc - 2) + 0.254 u d (k - 3) 

-0.016 u d (k - 4) - 0.192y(/c - 5) + 0.288 u d (k - 6) 

In Fig. 1, the open-loop and closed-loop frequency response functions from the disturbance 
input to the output are shown. The solid curve is the open-loop response and the dashed 
curve is the closed-loop response. The peaks in Fig. 1 of the open-loop response are consid- 
erably reduced (> 10 dB). 



Figure 1: Open-loop and closed-loop frequency response functions (FRF) 
from the disturbance input to the output 

Next, we consider the case where there is an additional measurement available for 
feedback control (unequal number of inputs and outputs). In addition to the acceleration of 
the third mass, acceleration measurement of the second mass is also available. The direct 
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transmission term in this case is non-zero. The minimum order of the ARX model is p = 3. 
For comparison purpose, the control parameter is kept at q = 50. The controller in this case 
is 

u c {k) = — 0.080u c (fc - 1) - 0.294 u c {k - 2) + 0.412u c (fc - 3) 

r i T Vi(k ~ 1) 

+ -0.456 4.805 

L [ 2/2 (k - 1) 

r 1 [ y 1 (k — 2) 

+ 0.746 0.233 

[ V2 (k - 2) 

r "j |~ i ( k 3 ) 

f- -0.4557 -5.461 

L [ V2{k — 3) 

-4.818u d (A: - 1) + 8.752 u d (k - 2) - 3.8985 u d (k - 3) 

Note that with the additional measurements, fewer time steps (and fewer controller gains) are 

required. This is a reflection of the fact that complete state estimation can now be achieved 

faster with the additional sensors. All three algorithms produce identical controllers for 

the noisc-frcc cases. The frequency response functions arc not shown here because they arc 

similar to the one shown in Fig. 1. 

Let the output be added with some measurement noise so that the signal to noise 
ratio is 4.5. The noise is random normally distributed. For the indirect algorithm, set the 
values of p and q to p = 10 and q = 30. Although the minimum order of the the ARX model 
is p — 3, the larger value is given to accommodate the measurement noise. The open-loop 
and closed-loop frequency response functions from the disturbance input to the first and 
second outputs are shown in Figs. 2 and 3. Again, all the peaks of the open-loop response 
function arc considerably reduced. Figure 3 shows the effect of the direct transmission term 
at frequencies near the Nyquist frequency. 

For the direct algorithm, set the values of p and q as p — 7 and q = 30. The open-loop 
and closed-loop frequency response functions from the disturbance input to the first and 
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Figure 2: Open-loop and closed-loop frequency response functions (FRF) 
from the disturbance input to the first output for the indirect algorithm 
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Figure 3: Open-loop and closed-loop frequency response functions (FRF) 
from the disturbance input to the second output for the indirect algorithm 
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second outputs arc shown in Figs. 4 and 5. Some differences can be seen from Figs. 2 and 3 
for the indirect algorithm, and Figs. 4 and 5 for the direct algorithm. Nevertheless, they arc 
very similar although their input and output gain matrices (not shown) are quite different. 
The direct algorithm takes somewhat a less value of p to achieve the same control effect. 
This docs not mean that the direct algorithm is computationally more efficient than the 
indirect algorithm. 

8 Concluding Remarks 

Three novel algorithms were developed for deadbeat predictive control designs. These al- 
gorithms arc simple and easy to compute and so they arc good candidates to be used for 
real-time implementation in a micro-processor. The first algorithm (indirect method) uses 
the multi-step-ahead output prediction to compute the control law. All computations are 
performed recursively. The most time consuming task is the computation of the matrix 
pseudo-inverse of a Hankcl matrix formed by the system pulse response time history. The 
Hankcl matrix plays the major role of establishing the rule of selecting the identification 
parameter and the control design parameter (i.c., control horizon). It also provides the 
basis to establish the uniqueness of the deadbeat predictive control law. Using the multi- 
step-ahead output prediction, the second algorithm (direct method) was developed combing 
system identification and control law into one formulation. It computes the Hankcl matrix 
and other quantities directly from input and output data. This by no means implies that the 
second algorithm is more robust or computationally efficient than the first one. Nevertheless, 
it provides a clear insight into the fundamental structure of the deadbeat predictive control 
law. The third algorithm provides the state-space representation of the deadbeat predictive 
control law. It computes the deadbeat gain for observer-based full-state feedback that may 
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Figure 4: Open-loop and closed-loop frequency response functions (FRF) 
from the disturbance input to the first output for the direct algorithm 



Figure 5: Open-loop and closed-loop frequency response functions (FRF) 
from the disturbance input to the second output for the direct algorithm 
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then be converted into the input and output gain used in the classical predictive control 
designs. The connection between the classical state-space control law and the predictive 
control law is clearly identified. Since the control gains arc designed from the input-output 
models, they may be adaptively tuned from on-line input and output measurements. As a 
result, these controllers should be able to handle the systems with slowly time-varying dy- 
namics, provided that input and output data arc sufficiently rich to allow' reasonable system 
identification. The system dynamics may be large and complex such as open-loop unstable, 
underdamped poles, etc. 
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